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(54) Information signal processing apparatus, information signal processing method, and 
information signal recording apparatus 



(57) An information signal processing apparatus in- 
cludes a first information signal reading unit (3) for re- 
ceiving or reading a predetermined first information sig- 
nal. A second information signal reading unit (7) re- 



ceives, detects, or reads a second information signal 
which includes attribute information regarding the first 
information signal. A characteristic detecting unit (6) de- 
tects a predetermined characteristic of the first informa- 
tion signal from the first information signal reading unit. 
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Description 

[0001] The present invention relates to information 
signal processing apparatuses and information signal 
processing methods for appropriately playing desired 
scenes from among recorded broadcast programs, for 
example, when writing and reading broadcast programs 
from information signal recording media such as mag- 
netic disks and magnetic tapes. 
[0002] Due to an increase in the recording capacity 
and a decrease in the price of recording media such as 
magnetic disks, users often record various broadcast 
programs for long periods of time. Consequently, a prob- 
lem arises in that it takes a significant amount of time to 
play the program. 

[0003] Methods for minimizing playback time have 
been proposed. For example, commercials can be de- 
tected and skipped, the audio level detected, and por- 
tions with low audio levels skipped. A predetermined pe- 
riod of time can simply be skipped and a predetermined 
section played, and this operation performed repetitively 
to minimize the playback time. 

[0004] Alternatively, a scene change can be detected, 
or sections with large audio levels be detected as climax 
scenes and preferentially played. 
[0005] The above-described conventional methods 
use predetermined detection systems or predetermined 
skipping systems, and they do not take into considera- 
tion the content of the program to be played. According- 
ly, scenes which the user does not want to see may be 
played, or sections that the user wants to see may be 
skipped or jumped. 

[0006] When a digest playback of a program such as 
a news report program in which the same news anchor 
appears and reads different news articles is performed 
at substantially regular intervals, the result does not 
seem to be a digest of the program since there are not 
great variations in image scenes, although there are var- 
iations in sound. As a result, a viewer may feel that the 
playback is merely a repetition of similar scenes and 
may not be able to fully understand the contents. 
[0007] In contrast, when a digest of a music program 
in which many singers appear is played so that digest 
playback sections are at approximately regular inter- 
vals, a viewer may enjoy the digest playback which is 
performed in this manner. 

[0008] In order to edit a music program or to rewind 
and play the introduction of a song, it may be more time- 
efficient to play a digest of a program at regular intervals. 
[0009] There has been no conventional technology 
which can efficiently control a digest playback in accord- 
ance with the contents of a program. 
[0010] Accordingly, it is an object of at least preferred 
embodiments of the present invention to provide a tech- 
nology which can perform appropriate playback in ac- 
cordance with the contents of a program when perform- 
ing specialized playbacks such as a digest playback of 
a broadcast program, a brief playback by skimming a 



program, similar scene detection, and the like. 
[0011] According to an aspect of the present inven- 
tion, the foregoing objects are addressed through pro- 
vision of an information signal processing apparatus, in- 

5 eluding a first information signal reading unit for receiv- 
ing or reading a predetermined first information signal. 
A second information signal reading unit receives, de- 
tects, or reads a second information signal which in- 
cludes attribute information regarding the first informa- 

10 tion signal. A characteristic detecting unit detects a pre- 
determined characteristic of the first information signal 
from the first information signal reading unit in accord- 
ance with a signal received or read by the second infor- 
mation signal reading unit. 

15 [0012] The first information signal may be a video or 
audio broadcast program signal. 
[0013] The second information signal may be a pro- 
gram information signal of a broadcast program. 
[0014] According to another aspect of the present in- 

20 vention, an information signal processing apparatus is 
provided, including a first information signal reading unit 
for receiving or reading a first information signal which 
includes at least one information signal. A second infor- 
mation signal reading unit receives, detects, or reads a 

25 second information signal which includes an attribute of 
the first information signal. A characteristic detecting 
unit detects a predetermined characteristic of the first 
information signal from the first information signal read- 
ing unit in accordance with a signal received or read by 

30 the second information signal reading unit. A reading 
control unit controls reading of the first information sig- 
nal in accordance with a detection signal from the char- 
acteristic detecting unit and a signal from the second 
information signal reading unit. 

35 [0015] The first information signal may be a broadcast 
program which includes at least an audio signal or a vid- 
eo signal. 

[001 6] The attribute of the first information signal may 
be an information signal which describes the outline or 
40 content of the first information signal or classification of 
information. 

[0017] The characteristic may be a characteristic 
used to detect a point which has predetermined similar- 
ity or a point which appears to be a climax of a prede- 

« termined period of time. 

[001 8] The reading control unit may read a point in the 
first information signal, which has predetermined simi- 
larity, or a point which appears to be a climax of a pre- 
determined period of time. 

50 [0019] When it is determined based on the second in- 
formation signal that the first information signal is a pre- 
determined signal, the reading control unit may perform 
reading by at least varying the length of a predetermined 
reading section. 

55 [0020] According to another aspect of the present in- 
vention, an information signal processing method is pro- 
vided, including a first-information-signal reading step 
of receiving or reading a first information signal which 
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includes at least one information signal. In a second- 
information-signal reading step, a second information 
signal which includes an attribute of the first information 
signal is received, detected or read. In a characteristic 
detecting step, a predetermined characteristic of the first 
information signal is detected in accordance with a sig- 
nal received or read in the second-information-signal 
reading step. In a reading control step, reading of the 
first information signal is controlled in accordance with 
a characteristic detection signal and the second infor- 
mation signal. 

[0021] The first information signal may be a broadcast 
program which includes at least an audio signal or a vid- 
eo signal. 

[0022] The attribute of the first information signal may 
be an information signal which describes the outline or 
content of the first information signal or classification of 
information. 

[0023] The characteristic may be a characteristic 
used to detect a point which has predetermined similar- 
ity or a point which appears to be a climax of a prede- 
termined period of time. 

[0024] In the reading control step, a point which has 
predetermined similarity or a point which appears to be 
a climax of a predetermined period of time may be read. 
[0025] In the reading control step, when it is deter- 
mined based on the second information signal that the 
first information signal is a predetermined signal, read- 
ing may be performed by at least varying the length of 
a predetermined reading section. 
[0026] According to another aspect of the present in- 
vention, an information signal recording apparatus is 
provided, including an information detecting unit for de- 
tecting predetermined information in a first information 
signal, based on a second information signal which in- 
cludes an attribute of the first information signal. A char- 
acteristic detecting unit detects a predetermined char- 
acteristic of the first information signal in accordance 
with a detection signal from the information detecting 
unit. An identification signal generating unit generates 
a predetermined identification signal based on a detec- 
tion signal from the characteristic detecting unit and the 
second information signal. A recording unit records the 
first information signal and the identification signal as 
predetermined recording signals on a predetermined re- 
cording medium. 

[0027] The first information signal may be a broadcast 
program which includes at least an audio signal or a vid- 
eo signal. 

[0028] The information detecting unit may detect an 
information signal which describes the outline or content 
of the first information signal or classification of informa- 
tion. 

[0029] The characteristic may be a characteristic 
used to detect a point which has predetermined similar- 
ity or a point which appears to be a climax of a prede- 
termined period of time. 

[0030] The identification signal may indicate a point 



in the first information signal, which has predetermined 
similarity, or a point which appears to be a climax of a 
predetermined period of time. 

[0031] As described above, a first information signal 

5 reading unit, such as a tuner of a television, receives or 
reads a predetermined first information signal, such as 
a broadcast program. Also, a second information signal 
reading unit receives or reads a second information sig- 
nal which includes an attribute, such as the contents of 

10 a program or program information, of the first informa- 
tion signal. In accordance with a signal received, detect- 
ed or read by the second information signal reading unit, 
a characteristic detecting unit detects a predetermined 
characteristic which is used to detect a climax scene of 

15 the first information signal from the first information sig- 
nal reading unit or to detect a similar scene. In accord- 
ance with a detection signal and the second information 
signal, a reading control unit controls reading of the first 
information signal. It is therefore possible to perform di- 

20 gest playback and playback in which predetermined 
similar scenes are retrieved and played. 
[0032] A predetermined identification signal can be 
generated based on a characteristic detection signal. 
The identification signal and information signals can be 

25 recorded on a predetermined recording medium. When 
reading the recording medium, specialized playback 
can be performed in accordance with the identification 
signal. 

[0033] According to the present invention, it is possi- 
30 ble to detect characteristics of broadcast program sig- 
nals in accordance with the type of a broadcast program. 
It is thus possible to perform a more accurate playback, 
skimming, and retrieval of desired similar images. Since 
a more advantageous digest playback can be per- 
35 formed in accordance with the genre of a program, a 
viewer can easily view the recorded contents in a short 
period of time, in a more time-efficient and understand- 
able manner. 

[0034] Embodiments of the invention will now be de- 
40 scribed, by way of example only, with reference to the 
accompanying drawings in which: 

Figs. 1A and 1B are conceptual diagrams of the 
principle of operation for processing information 
45 signals according to one example embodiment of 
the present invention; 

Figs. 2A and 2B are conceptual diagrams of the 
principle of playing similar scenes in accordance 
with a broadcast program which includes the infor- 

50 mation signals according to one example embodi- 
ment of the present invention 
Fig. 3 illustrates the principle of operation using an 
example of a scene in a news program which in- 
cludes the information signals according to one ex- 

55 ample embodiment of the present invention; 

Figs. 4A and 4B illustrate the principle of controlling 
digest playback sequences in accordance with the 
genre of a program which includes the information 
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signals according to one example embodiment of 
the present invention; 

Fig. .5 is a block diagram of an information signal 
processing apparatus according to an embodiment 
of the present invention; 

Fig. 6 is a block diagram of an information signal 
recording apparatus according to an embodiment 
of the present invention; 

Fig. 7 is a flowchart showing an example of a proc- 
ess performed the information signal processing 
apparatus; 

Fig. 8 is a table showing a list of examples of pre- 
ferred detection parameters to be set in accordance 
with the genre of a program which includes the in- 
formation signals according to one example embod- 
iment of the present invention; and 
Fig. 9 illustrates the principle of detecting a telop 
(television opaque projection) based on the infor- 
mation signals according to one example embodi- 
ment of the present invention. 

[0035] An information signal processing apparatus, 
an information signal processing method, and an infor- 
mation signal recording apparatus according to embod- 
iments of the present invention will be described with 
reference to the accompanying drawings. 
[0036] The outline of the present invention will now be 
described. When detecting a climax scene from a broad- 
cast program or a scene similar to one previously 
viewed, detection parameters for performing climax 
scene detection or similarity detection are appropriately 
changed in accordance with program information re- 
garding the broadcast program. Thus, detection can be 
performed more effectively. 

[0037] Predetermined playback control is performed 
in accordance with the detection result and the program 
information, and thus a digest playback or similar scene 
detection can be performed. A predetermined identifi- 
cation signal is generated in accordance with the detec- 
tion result, and the identification signal, together with the 
broadcast program, is recorded on a recording medium 
such as a magnetic disk or a semiconductor memory. 
[0038] Based on the detected program information, 
the length of a digest playback section is controlled in 
accordance with the program, e.g., a news program or 
a music program. 

[0039] As a result, playback is performed more effec- 
tively so that a viewer can easily and quickly understand 
the recorded content. 

[0040] The embodiments of the present invention will 
now be described in the following order: 

(1) The principle of operation of the present inven- 
tion 

(2) The structure of the information signal process- 
ing apparatus 

(3) The structure of the information signal recording 
apparatus 



(4) The information signal processing method 
(1 ) The principle of operation of the present invention 

5 [0041] Figs. 1A and 1B are conceptual diagrams of 
the principle of operation of the present invention. 
[0042] For example, it is assumed that a broadcast 
program is received and the program is recorded on a 
recording medium such as a magnetic disk. 

10 [0043] When receiving a broadcast program, a user 
can find out the genre of the program based on an elec- 
tronic program guide (EPG). For example, as shown in 
Fig. 1A, a particular broadcast program is received. 
Based on the EPG, the user finds out that the program 

is is a music program. 

[0044] In general, viewers of a music program want 
to watch scenes in which singers perform and want to 
know the singer, the song, and what point in the program 
the performance will take place. When viewers want to 

20 find out the content of the program quickly based on a 
digest playback, it is very efficient to only play scenes 
in which singers are performing. 
[0045] In order to do this, audio signals are detected, 
and spectral analysis of the audio signals is performed 

25 to determine the musical tone sections. Detected 
scenes (audio signal detected sections) are distin- 
guished using identification signals or the like. After- 
wards, it is possible to easily perform a digest playback 
of scenes in which singers perform. 

30 [0046] Referring to Fig. 1B, if it is determined based 
on the EPG that the genre of a program is drama or mov- 
ie, it is understood that a scene change or a large-audio- 
level section (in which the audio level is equal to a pre- 
determined level orgrater orthe luminance level is equal 

35 to a predetermined level or greater) is often a climax 
scene. Thus, such sections are detected. 
[0047] When such sections are detected, it is possible 
to perform a digest playback in an efficient manner sim- 
ilar to the foregoing music program. 

40 [0048] When the broadcast program is a news report 
program, it is understood that an efficient digest pro- 
gram can be performed by playing newscaster audio 
scenes. It is preferable that musical tone sections, which 
are to be detected in the above-described music pro- 

45 gram, be skipped. 

[0049] As described above, detection parameters for 
detecting audio sections and image scene sections are 
appropriately changed in accordance with the contents 
and the genre of a program. Thus, it is possible to per- 

50 form section detection in accordance with the program 
in a more efficient manner. As a result, more accurate 
digest playback and similarity detection can be per- 
formed. 

[0050] Figs. 2A and 2B are conceptual diagrams of a 
55 digest playback according to the present invention. Re- 
ferring to Fig. 2A. when performing a digest playback of 
a music program, musical tone sections are detected, 
and the digest playback is performed at substantially 
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regular intervals of t1, t2, and t3. Accordingly, a viewer 
can efficiently find out the contents of a song, which is 
sung by a singer in the program, in a short period of time. 
[0051] In the case of a news program, in general, the 
same news anchor reads news documents. When a di- 
gest of the news program is played at substantially reg- 
ular intervals as in the music program, scenes in which 
the news anchor is speaking are played. In this way, a 
viewer may feel that the contents of the digest playback 
are monotonous and may not be able to understand the 
content. 

[0052] As shown in Fig. 2B, digest playback intervals 
tn1, tn2, ... can be changed. If necessary, the playback 
can be controlled so that it skips to the subsequent sec- 
tion at a point at which a news image has been broad- 
cast for a predetermined period of time after the news 
anchor finishes reading the document describing the 
outline of the news. 

[0053] Fig. 3 shows an example of a news program. 
Oftentimes, a news anchor is on the screen in sections 
A1 and A3, and news images are broadcast in sections 
A2 and A4. 

[0054] Specifically, the scenes change between sec- 
tions A1 and A2, between sections A2 and A3, and be- 
tween sections A3 and A4. It is possible to perform 
scene change detection, in addition to similarity detec- 
tion, so that news images are played for a predeter- 
mined period of time. 

[0055] Accordingly, it is possible to reduce the chance 
that a digest playback will be monotonous because of 
reproducing only scenes in which the news anchor ap- 
pears. In this way, the viewer can understand the con- 
tent more easily. In order to perform a digest playback 
in a shorter period of time, it is possible to play a digest 
up to a point at which a scene change is detected. 
[0056] In this case, only image scenes in which the 
news anchor appears are played. In orderto prevent the 
digest playback from becoming monotonous, the length 
of a playback section can be changed every time a di- 
gest playback is performed. 

[0057] Figs. 4A and 4B are conceptual diagrams of 
the length of a digest playback of a news program and 
a music program as examples. Fig. 4A shows a case of 
the news program, and Fig. 4B shows a case of the mu- 
sic program. In Figs. 4A and 4B, the transverse direction 
corresponds to playback time of each digest playback 
sequence. 

[0058] Referring to Fig. 4A showing the news pro- 
gram, a scene in which a news anchor is on the screen 
is played. Subsequently, the scene changes to a news 
image scene, which is played for a predetermined peri- 
od of time. In Fig. 4A, a news image section tn is the 
same in each digest playback sequence in order to sim- 
plify the description. 

[0059] If the sum of a news anchor image section ta 
and the news image section tn is the same in each digest 
playback sequence, it is less likely that news image por- 
tions in these sequences are the same. Thus, the pos- 



sibility of the entire digest playback becoming monoto- 
nous is low. 

[0060] Alternatively, it is possible to make news an- 
chor image portions in a news program the same in ac- 
5 cordance with a viewer's preference. 

(2) The structure of the information signal processing 
apparatus 

10 [0061] Fig.5showsanexampleofthestructureofthe 
information signal processing apparatus according to 
the embodiment of the present invention. The structure 
includes a recording medium 1 which is a hard disk or 
a magneto-optical disk; a signal reading unit 2 for read- 

15 ing signals from the recording medium 1 ; a video signal 
processor 3 for processing video signals from among 
the read signals; a video signal output processor 4 for 
outputting the video signals detected by the video signal 
processor 3; a video monitor 5 for displaying the output 

20 video signals; a video characteristic detector 6 for de- 
tecting characteristics of the video signals from the vid- 
eo signal processor 3; an audio signal processor 7 for 
processing audio signals separated by the signal read- 
ing unit 2; an audio signal output processor 8 for output- 

25 ting the audio signals from the audio signal processor 
7; an audio output unit 9 for outputting the audio signals 
from the audio signal output processor 8; an audio char- 
acteristic detector 10 for detecting characteristics of the 
audio signals from the audio signal processor 7; a de- 

30 tection determining unit 1 1 for determining the video sig- 
nal characteristics detected by the video characteristic 
detector 6 and the audio signal characteristics detected 
by the audio characteristic detector 10; a recording in- 
formation signal detector 12 for detecting recording in- 

35 formation signals from among the signals read by the 
signal reading unit 2; a recording medium controller 13 
for controlling the recording of the recording medium 1; 
a user input unit 14 for inputting signals entered by a 
user by performing a predetermined operation; a system 

40 controller 1 5 for controlling the video characteristic de- 
tector 6, the audio characteristic detector 10, the detec- 
tion determining unit 11 , the recording information signal 
detector 1 2, the recording medium controller 1 3, the us- 
er input unit 14, a video characteristic data memory 16, 

45 and an audio characteristic data memory 1 7; the video 
characteristic data memory 16 for storing the video sig- 
nal characteristics detected by the video characteristic 
detector 6; and the audio signal characteristics data 
memory 17 for storing the audio signal characteristics 
50 detected by the audio characteristic detector 1 0. 

[0062] In the information signal processing apparatus 
with the foregoing arrangement, the recording medium 
1 is a recording medium such as a hard disk or a mag- 
neto-optical disk. First information signals, such as a 
55 predetermined broadcast program and other video/au- 
dio signals, and second information signals, such as the 
genre of the recorded broadcast program or the con- 
tents of the recorded information signals, identification 
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signals, and the like, are recorded in a predetermined 
recording region on the recording medium 1 in a prede- 
termined recording format. 

[0063] The signal reading unit 2 reads the information 
signals, which have been recorded on the recording me- 
dium 1 in the predetermined recording format, in a pre- 
determined reading format. Also, the signal reading unit 
2 performs various signal reading processes such as er- 
ror-correction coding (ECC) and separation of video sig- 
nals and audio signals. 

[0064] From among the read signals, the video sig- 
nals are input to the video signal processor 3, and the 
audio signals are input to the audio signal processor 7. 
The video and audio signals undergo predetermined de- 
coding or the like. The processed video signals are input 
to the video characteristic detector 6, and the audio sig- 
nals are input to the audio characteristic detector 1 0. 
Predetermined characteristic signals of the video and 
audio signals are detected. 

[0065] The second information signals are detected 
by the recording information signal detector 12. In ac- 
cordance with the detected information signals, detec- 
tion parameters for the video characteristic detector 6 
and the audio characteristic detector 10 are changed. 
Thus, the predetermined characteristic signals can be 
detected. 

[0066] Fig. 8 is a table of examples of preferred de- 
tection parameters which are set based on the detected 
second information signals. Fig. 8 shows detection pa- 
rameters which are to be preferentially detected. Detec- 
tion of general parameters such as silent sections is also 
performed in accordance with desired digest playback 
time. 

[0067] For example. Fig. 8 indicates that musical tone 
sections are preferentially detected in a music program. 
As described in 'Video browsing interface using sound 
information", The Institute of Image Information and Tel- 
evision Engineers technical report (February 3, 1995), 
musical tone detection is performed by detecting a spec- 
trum envelop of a signal and detecting its characteris- 
tics. 

[0068] Fig. 9 shows the principle of detecting a telop 
(television opaque projection) screen in the news pro- 
gram shown in Fig. 8. Screen A shows scenes 1, 2, 3, 
4, 5, 6, ... of the news program. It is assumed that news 
telops are broadcast in screens 3 and 4. 
[0069] As shown in screen A of Fig. 9, the average 
luminance level at each of three positions L1, L2, and 
L3 is considered. In screens 1 to 6, there are almost no 
scene changes. The average luminance level at position 
L1 , which is indicated by level B, and the average lumi- 
nance level at position L2, which is indicated by level C, 
do not vary very much. In contrast, the average lumi- 
nance level at position L3, which is indicated by level D, 
increases at screens 3 and 4 in which the telops appear 
at the bottom of the screen. 

[0070] In a news program, telop characters in white 
generally appear on the screen. Thus, at the time a telop 



appears, the average luminance level increases. 
[0071] By detecting a scene change and the average 
luminance level in a predetermined portions, it is possi- 
ble to detect a point at which telop characters are very 

5 likely to appear on the screen. 

[0072] Scene change detection can be performed by 
detecting a differential variation in the average lumi- 
nance level between frames and determining whether 
or not the differential variation is within a predetermined 

10 preset value. Alternatively, scene change detection can 
be performed by detecting a difference in image data 
between frames. 

[0073] Although programs such as music programs, 
drama and movie programs, news report programs, 

15 sports programs, variety shows, cooking programs, and 
other informative programs have been described, addi- 
tional genres can be added if necessary. Also, more ap- 
propriate detection parameters can be set. 
[0074] As described in the principle of operation of the 

20 present invention, for example, a digest playback 
around a news anchor portion of a news program can 
be performed so that a viewer can understand the con- 
tent of the program quickly. To do so, the viewer uses 
the user input unit 14 to designate similarity detection 

25 at the time the news anchor appears on the screen dur- 
ing the news program. 

[0075] The designation is input to the system control- 
ler 15, and predetermined characteristic data detected 
by the video characteristic detector 6 or the audio char- 
30 acteristic detector 1 0 at that time are temporarily stored 
in the video characteristic data memory 16 or the audio 
characteristic data memory 1 7. 

[0076] When performing similarity detection in the 
case of video signals, the characteristic data include lu- 

35 minance signals in predetermined portions and prede- 
termined compressed data processed by the video sig- 
nal processor 3. The data are sequentially detected , and 
the detection determining unit 11 computes correlation 
between the sequentially-detected data and the data 

40 stored in the video characteristic data memory 16. 
[0077] In the case of audio signals, similar operation 
is performed. Data in a frequency region, which is proc- 
essed by the audio signal processor 7, is detected by 
the audio characteristic detector 10. Characteristic data 

45 at the time the designation is input is temporarily stored 
in the audio characteristic data memory 17. Correlation 
of this data with characteristic data which are sequen- 
tially detected is computed. 

[0078] As a result of the computation, when predeter- 
50 mined correlation is detected, similarity detection is per- 
formed. The system controller 15 controls the recording 
medium controller 13 so that a predetermined section 
containing the detected point is played. 

55 (3) The structure of the information signal recording 
apparatus 

[0079] Fig. 6 shows an example of the structure of the 
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information signal recording apparatus according to the 
embodiment of the present invention. The structure in- 
cludes a tuner 1 20 for receiving signals from an antenna 
101; a video signal processor 20 for processing video 
signals from among the signals received by the tuner 
120; an audio signal processor 30 for processing audio 
signals received by the tuner 1 20; a recording video sig- 
nal processor 40 for processing video signals to be re- 
corded from among the video signals processed by the 
video signal processor 20; a video characteristic detec- 
tor 50 for detecting characteristics of the video signals 
from the video signal processor 20; a video character- 
istic data memory 51 for storing the video signal char- 
acteristics detected by the video characteristic detector 
50 in a memory; a first arithmetic processing unit 52 for 
performing arithmetic processing such as comparison 
between the video signal characteristics detected by the 
video characteristic detector 50 and the video data 
stored in the video characteristic data memory 51; an 
audio characteristic detector 60 for detecting character- 
istics of the audio signals processed by the audio signal 
processor 30; an audio characteristic data memory 61 
for storing the audio signal characteristics detected by 
the audio characteristic detector 60; a second arithmetic 
processing unit 62 for performing arithmetic processing 
such as comparison between the audio signal charac- 
teristics detected by the audio characteristic detector 60 
and the audio data stored in the audio characteristic da- 
ta memory 61 ; a recording audio signal processor 70 for 
processing audio signals to be recorded, from among 
the audio signals processed by the first arithmetic 
processing unit 52 and the video characteristic detector 
50 at the video signal side, by the audio characteristic 
detector 60, and by the audio signal processor 30; an 
identification signal generator 80 for generating identifi- 
cation signals based on the signals from the second 
arithmetic processing unit 62 at the audio signal side; a 
recording data multiplexer 90 for multiplexing the sig- 
nals from the recording video signal processor 40, the 
recording audio signal processor 70, and the identifica- 
tion signal generator 80; a recording unit 1 00 for record- 
ing the multiplexed signals; an EPG detector 1 30 for de- 
tecting EPG from signals from a recording medium 110 
to be recorded and from the tuner 120; a system con- 
troller 140 for controlling the EPG detector 130, the vid- 
eo characteristic detector 50, the audio characteristic 
detector 60, the video characteristic data memory 51 , 
the identification signal generator 80, the audio charac- 
teristic data memory 61 , a recording medium controller 
150, and a user input unit 160; the recording medium 
controller 1 50 for controlling the recording medium 110; 
and the user input unit 160 for inputting signals entered 
by the user. 

[0080] In the information signal recording apparatus 
with the foregoing arrangement, broadcast program sig- 
nals and EPG information signals are received by the 
antenna 101 and the tuner 120. 
[0081] From among the received broadcast program 



signals, video signals are input to the video signal proc- 
essor 20 and undergo predetermined signal processing 
such as video signal demodulation. Audio signals are 
input to the audio signal processor 30 and similarly un- 
5 dergo predetermined signal processing such as audio 
signal demodulation. 

[0082] The video signals that have undergone prede- 
termined signal processing are input to the recording 
video signal processor 40 and the video characteristic 
10 detector 50. 

[0083] The audio signals that have undergone prede- 
termined signal processing are input to the recording au- 
dio signal processor 70 and the audio characteristic de- 
tector 60. 

15 [0084] The signals from the tuner 120 are also input 
to the EPG detector 130, and the input signals are re- 
garded as signals different from the broadcast program. 
From the input signals, program information, such as the 
genre of the broadcast program, is detected. The de- 

20 tected predetermined information signals are input to 
the system controller 140. 

[0085] In accordance with the detected EPG informa- 
tion signals, predetermined characteristic data are de- 
tected by the video characteristic detector 50 and the 

25 audio characteristic detector 60, respectively, from 
among the broadcast program signals processed by the 
video signal processor 20 and the audio signal proces- 
sor 30. In accordance with the detection results, the 
identification signal generator 80 generates predeter- 

30 mined identification signals. 

[0086] As described in the principle of operation of the 
present invention, at the time of recording, for example, 
a digest playback around a news anchor portion of a 
news program can be performed so that a viewer can 

35 understand the content of the program quickly. In order 
to do this, the viewer uses the user input unit 1 60 to des- 
ignate similarity detection at the time the news anchor 
appears on the screen during the news program. 
[0087] The designation is input to the system control- 

40 ler 140. Predetermined characteristic data detected at 
that time by the video characteristic detector 50 or by 
the audio characteristic detector 60 is temporarily stored 
in the video characteristic data memory 51 or the audio 
characteristic data memory 61. 

45 [0088] When performing similarity detection in the 
case of video signals, characteristic data include lumi- 
nance signals in predetermined portions, predeter- 
mined compressed data processed by the video signal 
processor 20, and the like. The data are sequentially de- 

50 tected. The first arithmetic processing unit 52 computes 
correlation between the sequentially-detected data and 
the data stored in the video characteristic data memory 
51. 

[0089] In the case of audio signals, similar processing 
55 is performed. Data in a frequency region, which is proc- 
essed by the audio signal processor 30, is detected by 
the audio characteristic detector 60. Characteristic data 
at the time of designation is temporarily stored in the 
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audio characteristic data memory 61. Predetermined 
correlation processing is computed between the se- 
quentially-detected characteristic data and the data 
stored in the audio characteristic data memory 61. 
[0090] As a result of the computation, when predeter- 
mined correlation is detected, similarity detection is per- 
formed. At the time similarity is detected, the identifica- 
tion signal generator 80 generates a predetermined 
identification signal. The recording data multiplexer 90 
multiplexes the identification signal, the video recording 
data, and the audio recording data. The recording unit 
100 performs predetermined ECC interleaving or the 
like. Subsequently, the data is recorded on the recording 
medium 110. 

[0091] In this case, it is also possible to cause the 
identification signal generator 80 to generate a prede- 
termined identification signal so that the identification 
signal is read and detected at the time of reading. Ac- 
cordingly, a predetermined section including a point at 
which similarity is detected is played. 

(4) The information signal processing method 

[0092] Fig. 7 shows an example of a process per- 
formed by the information signal processing apparatus 
of the embodiment of the present invention. 
[0093] In step S1, the process starts. In step S2, the 
process receives a program. In step S3, the process de- 
tects program information based on EPG. 
[0094] In step S4, the process determines the genre 
of the program. In step S5, the process determines 
whether or not the program is a music program. If the 
determination is negative, the process determines in 
step S1 2 whether or not the program is a drama or movie 
program. If the determination is negative, the process 
determines in step S1 6 whether or not the program is a 
news report program. 

[0095] If it is determined in step S5 that the program 
is a music program, in step S6, the process sets detec- 
tion parameters as musical tone detection parameters. 
In step S7, the process detects a musical tone section. 
In step S8, the process generates a predetermined iden- 
tification signal indicating that the musical tone section 
has been detected. In step S9, the process performs 
predetermined recording signal processing of the re- 
ceived broadcast program data and the identification 
signal, and records the data on a recording medium. 
[0096] In step S10, the process determines whether 
to stop the operation. If the operation is stopped by a 
user, the process is terminated in step S11 . If the oper- 
ation is not stopped, the process returns to step S2, and 
the operation is repeated. 

[0097] If it is determined in step S1 2 that the program 
is a drama or movie program, in step S13, the process 
sets detection parameters in order to detect scene 
changes and climax scenes in which the audio level is 
a predetermined level or greater or the luminance of a 
screen is a predetermined level or greater. 



[0098] In step S14, the foregoing scene section is de- 
tected. In step S15, the process generates a predeter- 
mined identification signal which indicates the detected 
section. In step S9, the process performs predetermined 

5 recording signal processing of the received broadcast 
program data and the identification signal, and records 
the data on the recording medium. 
[0099] If it is determined in step S1 6 that the program 
is a news report program, in step S17, the process sets 

10 detection parameters as those suitable for the news re- 
port program, such as for speaker speech detection and 
musical tone skipping. 

[0100] In step S18, the process detects the foregoing 
scene section. In step S1 9, the process generates a pre- 

15 determined identification signal which indicates the de- 
tected section. In step S9, the process performs prede- 
termined recording signal processing of the received 
broadcast program data and the identification signal, 
and records the data on the recording medium. 

20 [0101] In the foregoing description, music programs, 
drama and movie programs, and news report programs 
have been described. Alternatively, detection parame- 
ters suitable for genres such as sports programs, variety 
shows, and the like, can be set, and detection can be 

25 performed accordingly. 

[0102] In this embodiment, in order to simplify the de- 
scription, when the process determines in step S16 that 
the genre of the program is other than the above three 
types, in step S20, the process sets detection parame- 

30 ters for detecting silence and low-level audio. In step 
S21 , the process performs such detection. In step S22, 
the process generates an identification signal. In step 
S9, the process performs predetermined recording sig- 
nal processing of the received broadcast program data 

35 and the identification signal, and records the data in the 
recording medium. 



Claims 

40 

1. An information signal processing apparatus com- 
prising: 

first information signal reading means for re- 
45 ceiving or reading a predetermined first infor- 

mation signal; 

second information signal reading means for 
receiving, detecting, or reading a second infor- 
mation signal which includes attribute informa- 

50 tion regarding the first information signal; and 

characteristic detecting means for detecting a 
predetermined characteristic of the first infor- 
mation signal from said first information signal 
reading means in accordance with a signal re- 

55 ceived or read by said second information sig- 

nal reading means. 

2. An information signal processing apparatus accord- 
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ing to Claim 1 , wherein the first information signal 
comprises a video or audio.broadcast program sig- 
nal. 

An information signal processing apparatus accord- 5 
ing to Claim 1 , wherein the second information sig- 
nal comprises a program information signal of a 
broadcast program. 

An information signal processing apparatus com- 10 
prising: 

first information signal reading means for re- 
ceiving or reading a first information signal 
which comprises at least one information sig- 15 
nal; 

second information signal reading means for 
receiving, detecting, or reading a second infor- 
mation signal which includes an attribute of the 
first information signal; 20 
characteristic detecting means for detecting a 
predetermined characteristic of the first infor- 
mation signal from said first information signal 
reading means in accordance with a signal re- 
ceived or read by said second information sig- 25 
nal reading means; and 
reading control means for controlling reading of 
the first information signal in accordance with a 
detection signal from said characteristic detect- 
ing means and a signal from said second infor- 30 
mation signal reading means. 

An information signal processing apparatus accord- 
ing to Claim 4, wherein the first information signal 
comprises a broadcast program which includes at 35 
least an audio signal or a video signal. 

An information signal processing apparatus accord- 
ing to Claim 4, wherein the attribute of the first in- 
formation signal comprises an information signal « 
which describes the outline or content of the first 
information signal or classification of information. 

An information signal processing apparatus accord- 
ing to Claim 4, wherein the characteristic comprises 45 
a characteristic used to detect a point which has 
predetermined similarity or a point which appears 
to be a climax of a predetermined period of time. 

An information signal processing apparatus accord- 50 
ing to Claim 4, wherein said reading control means 
reads a point in the first information signal, which 
has predetermined similarity, or a point which ap- 
pears to be a climax of a predetermined period of 
time. 55 

An information signal processing apparatus accord- 
ing to Claim 4, wherein, when it is determined based 



on the second information signal that the first infor- 
mation signal comprises a predetermined signal, 
said reading control means performs reading by at 
least varying the length of a predetermined reading 
section. 

10. An information signal processing method compris- 
ing: 

a first-information-signal reading step of receiv- 
ing or reading a first information signal which 
comprises at least one information signal; 
a second-information-signal reading step of re- 
ceiving, detecting, or reading a second informa- 
tion signal which includes an attribute of the first 
information signal; 

a characteristic detecting step of detecting a 
predetermined characteristic of the first infor- 
mation signal in accordance with a signal re- 
ceived or read in said second-information-sig- 
nal reading step; and 

a reading control step of controlling reading of 
the first information signal in accordance with a 
characteristic detection signal and the second 
information signal. 

1 1 . An information signal processing method according 
to Claim 10, wherein the first information signal 
comprises a broadcast program which includes at 
least an audio signal or a video signal. 

12. An information signal processing method according 
to Claim 1 0, wherein the attribute of the first infor- 
mation signal comprises an information signal 
which describes the outline or content of the first 
information signal or classification of information. 

13. An information signal processing method according 
to Claim 10, wherein the characteristic comprises a 
characteristic used to detect a point which has pre- 
determined similarity or a point which appears to be 
a climax of a predetermined period of time. 

14. An information signal processing method according 
to Claim 10, wherein, in said reading control step, 
a point which has predetermined similarity or a point 
which appears to be a climax of a predetermined 
period of time is read. 

15. An information signal processing method according 
to Claim 10, wherein, in said reading control step, 
when it is determined based on the second informa- 
tion signal that the first information signal comprises 
a predetermined signal, reading is performed by at 
least varying the length of a predetermined reading 
section. 

16. An information signal recording apparatus, com- 
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prising: 

information detecting means for detecting pre- 
determined information in a first information 
signal, based on a second information signal 5 
which includes an attribute of the first informa- 
tion signal; 

characteristic detecting means for detecting a 
predetermined characteristic of the first infor- 
mation signal in accordance with a detection *o 
signal from said information detecting means; 
identification signal generating means for gen- 
erating a predetermined identification signal 
based on a detection signal from said charac- 
teristic detecting means and the second infor- <s 
mation signal; and 

recording means for recording the first informa- 
tion signal and the identification signal as pre- 
determined recording signals on a predeter- 
mined recording medium. 20 

17. An information signal recording apparatus accord- 
ing to Claim 16, wherein the first information signal 
comprises a broadcast program which includes at 
least an audio signal or a video signal. 25 

18. An information signal recording apparatus accord- 
ing to Claim 16, wherein said information detecting 
means detects an information signal which de- 
scribes the outline or content of the first information 30 
signal or classification of information. 

19. An information signal recording apparatus accord- 
ing to Claim 16, wherein the characteristic compris- 
es a characteristic used to detect a point which has 35 
predetermined similarity or a point which appears 

to be a climax of a predetermined period of time. 

20. An information signal recording apparatus accord- 
ing to Claim 1 6, wherein the identification signal in- *o 
dicates a point in the first information signal, which 
has predetermined similarity, or a point which ap- 
pears to be a climax of a predetermined period of 
time. 
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